Visualizations of AI “thinking” in R

This package provides functions for visualizing AI / Machine Learning. Currently only one learning process is supported, namely LASSO regression with cross-validation.

Written by Sondre U. Solstad, Princeton University (ssolstad@princeton.edu). Send me an email if you find this package useful or want to suggest an improvement or feature.

Lasso coordinate descent and cross-validation:

Installation instructions:

library(devtools)
install_github("sondreus/seeAI")

Example:

library(seeAI)
library(glmnet)

set.seed(1010)
n=1000;p=100
nzc=trunc(p/10)
x=matrix(rnorm(n*p),n,p)
beta=rnorm(nzc)
fx= x[,seq(nzc)] %*% beta
eps=rnorm(n)*5
y=drop(fx+eps)
px=exp(fx)
px=px/(1+px)
ly=rbinom(n=length(px),prob=px,size=1)

set.seed(1011)
cvob1 <- cv.glmnet(x,y)

animate_glmnet(cvob1)

Arguments:

cv.glmnet An object of class ‘cv.glmnet’
replay Should the animation be replayed in the visual device? Defaults to FALSE.
plot.cv Should cross-validation error be plotted? Defaults to TRUE.
total.time Desired time of animation in seconds. Defaults to 15 if plot.cv selected, else 10.
new.save Should this animation be saved as a new object rather than overwrite the preceeding animation? Defaults to TRUE.
save Save as “html” or “gif”? Defaults to “html”.
debug Only plot subset of lambda values? Defaults to FALSE.
debug.n If plotting subset of lambda values, sets number of values to plot. Defaults to 10.
captions Should captions be added to animation? Defaults to FALSE.
captions.alt Should alternative captions be added to animation? Defaults to FALSE.
transition.n How many frames should be used to transition between cross-validation and model fit? Defaults to 10.
… Options passed to saveHTML or saveGIF functions. See ?animate::saveHTML and ?animate::saveGIF

Explanation and detail

Line segments are coefficients, outward from the central circle being positive and inward negative. As the complexity parameter (“lambda”) is being reduced, the size and number of non-zero coefficients decreases. Once the process is complete, a cross-validation procedure selects the ideal model (with the cross-validation error and the standard deviation of this error plotted on the right). Typically, the simplest model with a cross-validation error less than one standard deviation more than the model with the lowest the cross-validation error is preferred.

With Captions (Alt. 1)

With Captions (Alt. 2)

Acknowledgements

This package relies on the glmnet package by Jerome Friedman, Trevor Hastie, Noah Simon and Rob Tibshirani, and the animation package by Yihui Xie.